Papers with selection methods
Does GPT-3 Generate Empathetic Dialogues? A Novel In-Context Example Selection Method and Automatic Evaluation Metric for Empathetic Dialogue Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Empathy is a multi-dimensional concept consisting of cognitive and affective aspects. |
| Approach: | They propose two new in-context example selection methods that utilize emotion and situational information. |
| Outcome: | The proposed method is effective in measuring the degree of human empathy. |
RELIC: Enhancing Reward Model Generalization for Low-Resource Indic Languages with Few-Shot Examples (2025.findings-emnlp)
Copied to clipboard
Soumya Suvra Ghosal, Vaibhav Singh, Akash Ghosh, Soumyabrata Pal, Subhadip Baidya, Sriparna Saha, Dinesh Manocha
| Challenge: | a new reward model for low-resource Indic languages is proposed . a preference-based training approach is prohibitively expensive, authors say . |
| Approach: | a new in-context learning framework is proposed to train a retriever to select in-constext examples from low-resource Indic languages. |
| Outcome: | a new in-context learning framework for reward modeling in low-resource Indic languages is developed . the proposed framework outperforms existing examples on three preference datasets . |
InstructEval: Systematic Evaluation of Instruction Selection Methods (2024.findings-naacl)
Copied to clipboard
| Challenge: | In-context learning (ICL) performs tasks by prompting a large language model using an instruction and a small set of annotated examples. |
| Approach: | They develop an ICL evaluation suite to evaluate the performance of popular instruction selection methods. |
| Outcome: | The proposed evaluation suite compares instruction selection methods over five metrics relevant to ICL. |
Long-Range Language Modeling with Selective Cache (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models that use transformers to model language cost quadratically increase with sequence length. |
| Approach: | They propose a selective cache which stores key-value pairs from previous contexts. |
| Outcome: | The proposed selective cache outperforms XL cache and compressive cache by considerable margins. |
Demonstration Selection Strategies for Numerical Time Series Data-to-Text (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Demonstration selection is a critical step in in-context learning, where a prompt is fed into large language models. |
| Approach: | They propose to use sequence similarity-based selection and task-specific knowledge-based demonstration selection methods to select similar instances from an example bank. |
| Outcome: | The proposed methods outperform baseline selections and often surpass fine-tuned models on two benchmark datasets and human judges confirm their performance. |
UCS: Estimating Unseen Coverage for Improved In-Context Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing selection methods prioritize heuristic notions of relevance or diversity and provide limited insight into the coverage of a demonstration set. |
| Approach: | They propose a training-free, subset-level coverage prior that is unrevealed by a model-consistent embedding and a Smoothed Good-Turing estimator to estimate the number of unrevelled clusters within a candidate subset. |
| Outcome: | Experiments on multiple intent-classification and reasoning benchmarks show that augmenting strong baselines with UCS improves ICL accuracy by 2-6% under the same selection budget. |
One2Set + Large Language Model: Best Partners for Keyphrase Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing selection methods make redundant selections, causing poor recall and accuracy. |
| Approach: | They propose a framework to generate keyphrases from a one2set-based model and an LLM as selector. |
| Outcome: | The proposed framework surpasses state-of-the-art models in absent keyphrase prediction. |
RAISE: Reinforced Adaptive Instruction Selection For Large Language Models (2025.findings-emnlp)
Copied to clipboard
Qingsong Lv, Yangning Li, Zihua Lan, Zishan Xu, Jiwei Tang, Tingwei Lu, Yinghui Li, Wenhao Jiang, Hong-Gee Kim, Hai-Tao Zheng, Philip S. Yu
| Challenge: | Existing selection methods rely on static, heuristic quality scores and are executed only once before training. |
| Approach: | They propose a dynamic selection framework that integrates selection into every training step. |
| Outcome: | The proposed framework integrates selection into every training step. |
Linear-Time Demonstration Selection for In-Context Learning via Gradient Estimation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to select demonstration examples for in-context learning are based on token embeddings. |
| Approach: | They propose an algorithm to select demonstration examples for in-context learning of a query set . they use gradients of the output taken in the input embedding space to estimate model outputs . |
| Outcome: | The proposed algorithm outperforms existing methods based on token embeddings by 11% . it scales up subset selection that would otherwise run full inference by 37.7 on models with 34 billion parameters . |
Priority on High-Quality: Selecting Instruction Data via Consistency Verification of Noise Injection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for instruction selection rely on external models or rules, overlooking the intrinsic association between pre-trained model and instruction data. |
| Approach: | They propose a method that utilizes noise injection to identify the quality of instruction data without relying on external models. |
| Outcome: | The proposed method outperforms the model trained on the entire dataset and established baselines. |